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METHOD AND APPARATUS FOR ACTIVATING A MEDIA PLAYER 
BASED ON USER BEHAVIOR 

5 

Field of the Invention 

The present invention relates to methods and apparatus 
for controlling media players and other devices, and more 
particularly, to a method and apparatus for automatically 
10 activating a media player based on user activity. 

Background of the Invention 

The consumer marketplace offers a wide variety of 
Q electronic devices, such as televisions, stereo systems and 
l|l personal computers, that provide an ever-growing number of 
!fj features intended to increase the convenience and capabilities of 
jlj these devices. Most entertainment devices, for example, have an 
^ associated remote control device that allows the user to adjust a 
number of the device settings remotely. For example, a user can 
2|| activate a television or adjust the program channel, volume and 
other settings of the television using a remote control, in a 

111 

m - well-known manner. 

H While remote controls and other additional features 

have greatly improved the convenience of such entertainment 

25 devices, they still require the affirmative action of the user to 
manipulate the remote control (or another input mechanism 
associated with the device) to turn on the device or indicate the 
manner in which the particular device settings should be 
adjusted. Thus, if the remote control is not readily available, 

30 or the user does not wish to move closer to the device itself, 
the user may still be unable to conveniently activate the device 
or adjust one or more settings in a desired manner. 

It has been observed that there is often a predictable 
relationship between certain user activity and a corresponding 

35 manner in which the settings of an electronic device should be 
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adjusted. For example, it may be observed that when a particular 
user sits in a particular chair at a certain time of day, the 
user also tends to turn on the television set using the remote 
control. There is currently no mechanism, however, that learns 

5 such ritualistic user activity and automatically activates the 
electronic device. A need therefore exists for a media player 
controller that monitors user activity and automatically 
activates a media player in response to predefined events or 
behavior. A further need exists for a media player controller 

10 that employs a rule-base to define user activities or events, as 
well as the corresponding response that should be implemented to 
im activate the device. 

ji Sum mary of the Invention 
y i — — — — — — 

l|3 Generally, a method and apparatus are disclosed for 

fi monitoring user activity and automatically activating a media 
player in response to predefined events. The disclosed media 

si 

m player controller includes one or more audio/visual capture 
j 11 devices focused on one or more users. The obtained audio and 
2f|l video information is processed by the media player controller to 
M identify one or more predefined events. 

According to one aspect of the invention, a number of 
behavior rules define various user activities or events that 
suggest that the user would like to activate a media player. 
25 Each rule contains one or more conditions, and, optionally, a 
corresponding action-item that should be performed when the rule 
is satisfied to activate the media player. Upon detection of a 
predefined event, the corresponding action, if any, is performed 
by the media player controller. 
30 A more complete understanding of the present invention, 

as well as further features and advantages of the present 
invention, will be obtained by reference to the following 
detailed description and drawings. 
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Brief Description of the Drawings 

FIG. 1 illustrates a media player controller in 
accordance with the present invention; 
5 FIG. 2 illustrates a sample table from the user profile 

of FIG. 1 in accordance with the present invention; and 

FIG. 3 is a flow chart describing an exemplary user 
event monitoring process embodying principles of the present 
invention . 

10 

Detailed Description 

FIG. 1 illustrates a media player controller 100 in 

G 

accordance with the present invention. As shown in FIG. 1, the 
m media player controller 100 includes one or more audio/visual 
lP capture devices 150-1 through 150-N (hereinafter, collectively 
|| referred to as audio/visual capture devices 150) that are focused 
* on one or more user(s) 140 of a media player 160. 

m Each audio/visual capture device 150 may be embodied, 

in for example, as a fixed or pan-tilt-zoom (PTZ) camera for 
201 capturing image or video information, or one or more microphones 
jhf for capturing audio information (or both) . The audio and video 
information generated by the audio /visual capture devices 15 0 are 
processed by the media player controller 100, in a manner 
discussed below in conjunction with FIG. 3, to identify one or 
25 more predefined user activities or events suggesting that the 
user would like to activate one or more media player (s) 160. In 
one implementation, the present invention employs a user profile 
200, discussed further below in conjunction with FIG. 2, that 
identifies user behavior that should initiate the activation of 
30 the media player 160 in accordance with the present invention. 

The user behavior defined in the profile 2 00 may be 
detected by the media player controller 100 in accordance with 
the present invention. As discussed further below, each behavior 
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rule contains one or more criteria that must be satisfied in 
order for the rule to be triggered, and, optionally, a 
corresponding action-item that should be performed by the media 
player controller 100 to activate the media player 160 when the 
predefined criteria for initiating the behavior rule is 
satisfied. 

At least one of the criteria for each rule is a 
condition detected in the audio or video information generated by 
the audio/visual capture devices 150 using audio or vision-based 
techniques, in accordance with the present invention. Upon 
detection of such predefined user behavior, the corresponding 
action, if any, is performed by the media player controller 100. 
Typically, the corresponding action is the issuance of a command 
to turn on (or off) the media player 160. 

As discussed further below in conjunction with FIG. 2, 
the user behavior recorded in the user profile 200 may include 
one or more criteria that is dependent on external information, 
such as information from an optional electronic program guide 
130. For example, the corresponding action-item that is 
performed by the media player controller 100 in response to a 
given user activity may be dependent on features of a program, as 
indicated in the electronic program guide 13 0. 

As shown in FIG. 1, and discussed further below in 
conjunction with FIG. 3, the media player controller 100 also 
contains a user event monitoring process 300. Generally, the 
user event monitoring process 300 processes the audio information 
or images obtained by the audio/visual capture devices 150 and 
detects one or more predefined behavior actions that should 
trigger the activation of a media player 160. 

The media player controller 100 may be embodied as any 
computing device, such as a personal computer or workstation, 
that contains a processor 120, such as a central processing unit 
(CPU), and memory 110, such as RAM and/or ROM. Alternatively, 
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the media player controller 100 may be embodied as an application 
specific integrated circuit (ASIC) (not shown) that is included, 
for example, in a television, set-top terminal or another 
electronic device . 
5 FIG. 2 illustrates an exemplary table of the user 

profile (s) 200 that records various behavioral rules for one or 
more users. Each rule in the user profile (s) 200 identifies the 
corresponding user(s) and includes predefined criteria specifying 
the conditions under which the rule should be initiated, and, 
10 optionally, a corresponding action item that should be triggered 
when the criteria associated with the rule is satisfied. 
Typically, the action item identifies the media player (s) 160 
J that should be activated when the rule is triggered. 
|5 As shown in FIG. 2, the user profile 2 00 is comprised 

1|3 of a plurality of records, such as records 205-208, each 
LS associated with a different behavioral rule. For each rule, the 
€1 user profile 200 identifies the corresponding user(s) in field 
<U 250, the corresponding rule criteria for a given behavioral event 
W in field 260 and the corresponding action, if any, in field 270. 
2S For example, the user habits recorded in record 2 05 for 

p the user, John Smith, indicates that the user generally turns on 
the television to a certain channel after checking the mail, 
putting out the garbage and sitting in a certain chair. 
Likewise, the user habits recorded in record 206 for the user, 
25 Jane Smith, indicates that the user likes to watch a news program 
while preparing dinner. Finally, the exemplary user habits 
recorded in record 208 for all users indicates that most users 
would like to turn on the television tuned to the highest ranking 
program when they sit in a certain seat with their feet up. 
30 Thus, the preferences in record 2 08 are dependent upon 
information from the electronic program guide 130. 

Generally, the user behavior recorded in the user 
profile(s) 200 can be obtained explicitly, i.e., from survey 
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responses, or implicitly, by monitoring how a given user responds 
to a given set of circumstances. Thereafter, a rule can be 
established that defines the given set of circumstances and the 
corresponding action item that should be performed. 

5 FIG. 3 is a flow chart describing an exemplary user 

event monitoring process 300. The user event monitoring process 
3 00 processes audio or video information (or both) obtained from 
the audio/visual capture devices 150 and detects one or more user 
events defined in the user profile 200. The exemplary user event 
10 monitoring process 300 is a general process illustrating the 
broad concepts of the present invention. As shown in FIG. 3, the 
user event monitoring process 3 00 initially obtains one or more 

\Q inputs from the audio/visual capture devices 150 during step 305. 

S Thereafter, the user event monitoring process 3 00 optionally 
ill identifies the user(s) that are present during step 310, for 

j| example, using a biometric evaluation of the audio or visual 

"0 information obtained from the audio/visual capture device 150. 

^ Thereafter, the audio/visual information is analyzed 

W during step 32 0 using audio and/or video content analysis (VCA) 
2& techniques. For a detailed discussion of suitable audio content 

W analysis techniques, see, for example, Silvia Pfeiffer et al . , 
"Automatic Audio Content Analysis," Proc . ACM Multimedia 96, 21- 
30, Boston, MA. (Nov. 1996), incorporated by reference herein. 
For a detailed discussion of suitable VCA techniques, see, for 
25 example, Nathanael Rota and Monique Thonnat, "Video Sequence 
Interpretation for Visual Surveillance, " in Proc. of the 3d IEEE 
Int'l Workshop on Visual Surveillance, 59- 67, Dublin, Ireland 
(July 1, 2000), and Jonathan Owens and Andrew Hunter, 
"Application of the Self -Organizing Map to Trajectory 
30 Classification,' in Proc. of the 3d IEEE Int'l Workshop on Visual 
Surveillance, 77-83, Dublin, Ireland (July 1, 2000), incorporated 
by reference herein. Generally, the audio content analysis and 
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VCA techniques are employed to recognize various features in the 
signals obtained by the audio/visual capture devices 150. 

A test is performed during step 330 to determine if the 
audio/video content analysis detects a predefined event, as 
defined in the user profile 300. If it is determined during step 
330 that the audio/video content analysis does not detect a 
predefined event, then program control returns to step 310 to 
continue monitoring user activities in the manner discussed 
above . 

If, however, it is determined during step 330 that the 
audio/ video content analysis detects a predefined user event, 
then the event is processed during step 340 as indicated in field 
270 of the user profile 200, if any, for the identified user. 
Program control then terminates (or returns to step 310 and 
continues monitoring user activities in the manner discussed 
above) . 

It is to be understood that the embodiments and 
variations shown and described herein are merely illustrative of 
the principles of this invention and that various modifications 
may be implemented by those skilled in the art without departing 
from the scope and spirit of the invention. 



